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Abstract — In this paper, we study the capacity of the diamond 
channel. We focus on the special case where the channel between 
the source node and the two relay nodess are two separate links 
of finite capacity and the link from the two relay nodes to the 
destination node is a Gaussian multiple access channel. We call 
this model the Gaussian multiple access diamond channel. We 
propose both an upper bound and a lower bound on the capacity. 
Since the upper and lower bounds take on similar forms, it is 
expected that they coincide for certain channel parameters. To 
show this, we further focus on the symmetric case where the 
separate links to the relays are of the same capacity and the power 
constraints of the two relays are the same. For the symmetric 
case, we give necessary and sufficient conditions that the upper 
and lower bounds meet. Thus, for a Gaussian multiple access 
diamond channel that satisfies these conditions, we have found 
its capacity. 

I. Introduction 

The diamond channel was first introduced by Schein in 2001 
ill]. It models the communication from a source node to a 
destination node with the help of two relay nodes. The channel 
between the source node and the two relays form a broadcast 
channel as the first stage and the channel between the two 
relays and the destination node form a multiple access channel 
as the second stage. The capacity of the diamond channel in its 
most general form is open. Achievability results were proposed 
in JT], while for the general diamond channel, the best known 
converse results is still the cut-set bound [2\. Capacity has 
been found for some special classes of diamond channels in 
0, f4\. 

The problem of sending correlated codes through a multiple 
access channel was studied in |5]. This channel model can be 
regarded as a special class of the diamond channel where the 
broadcast channel between the source node and the two relay 
nodes are two separate links of finite capacity. We call this 
the multiple access diamond channel. Achievability results for 
the discrete multiple access diamond channel were proposed 
in 0, jg. 

In this paper, we consider the multiple access diamond 
channel where the multiple access channel from the two relay 
nodes to the destination node is Gaussian, see Figure 1. We 
call this channel model the Gaussian multiple access diamond 
channel. We first propose an upper bound on the capacity 
which is tighter than the cut-set bound. The main technique 
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we use in the upper bound derivation is the introduction of 
an imaginary random variable used to bound the correlation 
between the two relay signals. This technique has also been 
used in solving the Gaussian multiple description problem [JJ. 
We then propose a lower bound on the capacity where the 
relays send correlated codewords into the channel. Comparing 
the upper and lower bounds, we find that they are of similar 
forms and therefore, when the channel parameters satisfy 
certain conditions, they would coincide, yielding the capacity. 
To illustrate this, we focus our attention on the symmetric case, 
where the power constraints of the relay nodes are the same 
and the links from the source node to the two relay nodes 
are of the same capacity. For the symmetric case, we give 
necessary and sufficient conditions that the upper and lower 
bounds meet. Thus, for a symmetric Gaussian multiple access 
diamond channel that satisfies these conditions, we have found 
its capacity. 

II. System Model 

We consider the Gaussian multiple access diamond channel, 
see Figure [T] The capacity of the link from the source node to 
Relay k is Rk, k = 1,2. The received signal at the destination 
node is 

Y = Xi+X2 + U 

where Xi and X2 are the input signals from Relay 1 and 
Relay 2, respectively, and [/ is a zero-mean unit-variance 
Gaussian random variable. It is assumed that U is independent 

to {Xi,X2). 

Let be a message that the source node would like to 
transmit to the destination node. Assume that W is uniformly 
distributed on {1, 2, • • • , M}. An (M, n, e„) code consists of 
an encoding function at the source node 

/" : {1,2,- - • ,M} ^ {1,2,- - • ,2"-"i} X {1,2,- - • ,2"-"^}, 

two encoding functions at the relays 

fl! : {1,2,--- ,2"-"'=} ^M", 



1,2 



which satisfy the average power constraint: for any xJJ that 
Relay k input into the Gaussian multiple access channel, it 
satisfies 
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<Pk, k = l,2 



Relay 1 



Power Pi 




— A 

>^ w 



Power P2 



Relay 2 

Fig. 1. The Gaussian multiple access diamond channel 

and one decoding function at the destination node 

5" :M"^{1,2,--- ,M} 
The probability of error is defined as 

M 
w — l 

Rate R is said to be achievable if there exists a sequence of 
(2"^, n, e„) codes such that en as n ^ 00. The capacity 
of the Gaussian multiple access diamond channel is supremum 
of all achievable rates. 

We would like the characterize the capacity of the Gaussian 
multiple access diamond channel in terms of the channel 
parameters i?i , i?2 , Pi and P2 . 

III. An Upper Bound 

Theorem 1 An upper bound on the capacity of the Gaussian 
multiple access diamond channel is 



where 



Ti = max min ■ 

0<p<p* 



T2 — max min ■ 

p'<p<i 



max(Ti,r2) 



i?i + i log[l + (1 - p2)P2] 
R2 + \ log[l + (1 - p2)Pi] 
ilog[l + Pi+P2 + 2p/P^ 

1 log 1 



(1) 



R -i I 2 
ilog[l 
Ri 



flog[l 
1 log[l 

i?2 



and 



1 



P2 + 2p/P^ 



1 



(2) 



4P1P2 2VprF^ 



Remark: The cut-set bound for the Gaussian multiple access 
diamond channel is 

i?l + i l0g[l + (1 - p2)P2] 
i?2 + i l0g[l + (1 - p2)Pl] 

ilog[l + Pi 

Pi + P2 



max mm ■ 

0<p<l 



P2 + 2p/P^ 
Hence, our upper bound is tighter than the cut-set bound. 



Proof: From the cut-set bound, we always have 

P < Pi + P2 (3) 

We also have 

nP = B{W) (4) 

= P(Xr, X^') + B{W\Xl, X2") (5) 

< P(Xf, X'i) + P(M^|r") (6) 
<P(Xr,X^')+ne„ (7) 

< /(Xi", X2"; r") + H{Xl, X2"|r") + ne„ 
</(Xr,X2";r") + 2ne„ (8) 

= - /i(y"|Xi",x^') + 2ne„ 

71 

^/i(y")__log(27re) + 2ne„ (9) 

where Q is because without loss of generality, we may 
consider deterministic encoders, i.e., is a deter- 

ministic function of W , I© is because of Markov chain 
W -> (Xr,^2") -> and © and © both follow from 
Fano's inequality. We further have 



nR = B{W) 

> I{X^,X^;Y'') 

11 



(10) 
(11) 

(12) 



(fTTI) is follows from the same reasoning as (|5). Now, we upper 
bound /i(y") as 

n 



< ^ - log(27re) (Pu + P2^ + 2p,y/P^^ + 1 



(13) 



where in (fTsT l. we have defined Pki = P[X^J,fc = 1,2 and 
pj _ M^i^iJ-, and used the fact that given power constraint, 
the Gaussian distribution maximizes the differential entropy. 
Another upper bound on P is 



nR<H{Xl\X^) + ne„ 

= P(Xi"|X2") + HiX'2') + ne„ 
< H{X^\X^) + nR2 + nen 



(14) 



+ P(Xr|r",X2") + nP2 + ne„ 



< I(X[';Y''\X'2' 



< 



nR2 + 2ne„ 
I{Xu■,Y,\X2^)+nR2 + 2ne„ 
1 



^ H ^ log [(1 - + 1] + + 2ne„ (15) 

where (fT4] i is because of (|7]i and (fTsT l follows from the same 



reasoning as (fTSl l. Similarly, 

" 1 

ni? < ^ - log [(1 - p^,)P2^ + 1] + ni?i + 2ne„ 

i=l 

Since the inputs from Relay 1 must satisfy the average power 
constraint Pi, we have 

^ n 1 ^ 

0<-^P?Ph<-^Ph<Pi 

1=1 i=l 

Therefore, there exists a pa E [0,1] such that 

n 
i=l 

Due to the concavity of the logarithm function, we have 

1 " 1 

i? < - V - log[(l - p^,)Pu + 1] + i?2 + 2e„ 



n ^ 2 

2 — 1 



+ i?2 + 2e„ 



1 /i " 1 " \ 

<^^og[-J2Pu^-Y.plPu + l]+R2 + 2e^ 

\ i=l i=l / 



< I log [(1 - pI)Pi + 1] + i?2 + 2e„ 
By a similar argument, from (ITjI . we have 

-/i(y") 



(16) 



1 / 1 " \ 

< -log(27re) \ -J2^[Pu + P2^ + 2\p,\y/I\~I^, + ^n 

< i log(27re) (^Pi+P2 + l^J2 2\/p?-PhP2. + 1^ 



From Cauchy-Schwarz inequality, we have 



i=l \ \ i=l / \ i=l 



P2. 



Thus, we have 

< i\ogi2ne)(Pi+P2+2pa^/p[P^+l] (17) 
Similarly, there exists a pb E [0, 1] such that 

1 " 

n ^ — ' 

1=1 

and we have 

< i log [(1 - pDP2 + 1] + i?i + 2e„ (18) 



< -log(2^e) Pi+P2 + 2pb/P^+l (19) 
Let us define p £ [0,1], which is a function of as 



follows: If 

< i log(27re)(l + Pi + P2) (20) 
n 2 

then p ~ 0; otherwise, p is such that 

-h{Y'') - i log(27re)(l + Pi + P2 + 2p^/P^) (21) 
n 2 

For the case when p = 0, from ([l6ll, (HHl, ©, ^ and (O), 
and letting n — > 00, we have 



i?< -log[(l-p')Pi + l] +P2 

< ^ log [(1 - p2)P2 + 1] + Pi 



(22) 
(23) 



i? < 2 log(l + P1 + P2 + 2p^/pJ^) (24) 



i?<i?i+i?2-^logY^ 
which means, for the case of p = 0, P < Ti. 



(25) 



For the case of p > 0, since must satisfy ( fTTI ) and 

(O, we see that p < min(pa, pt). This means from (fTST l. ( fTsT i, 
(O and (fT2l i. that we have 

< ^ log (1 + (1 - p')Pi) + P2 + 2e„ (26) 

i? < ^ log (1 + (1 - p')P2) + Pi + 2e„ (27) 



i log (1 + Pi + P2 + 2p/pr^) < P 



< - log (^1 + Pi + P2 + 2p/P^j + 2e„ (28) 

If p further satisfy < p < p*, which is equivalent to 
\/P\P2 ( - ~ /O ) ^ 1 > 0, we define additional random 



variables 



Z, = Y, + Ui i = l,...,n 



where [/'" is an i.i.d. Gaussian sequence with mean zero and 
variance 



N=^/l\P2[ - -p) - 1 



1 



(29) 



and is independent to everything else. We have 

2nP < 2H{Xl\ Xl^) + 2ne„ (30) 
= P(Xr, XJ^) - /(Xi"; X^') + P(Xi") + P(X^O + 2ne„ 

< P(XJ\ X^') - /(Xi"; + nPi + nP2 + 2ne„ 

< /(Xi", X^; r") - /(Xi"; + nPi + nPs + 3jie„ 

(31) 

where (|30] | follows because of (|7]i, and dJTT i follows from dHJ. 



Note that 

I{Xl^;X^) 

> I{X^; Z") - I{X^^; Z"|X2") 

(32) 

We further have 



1 + N 
(1 - p'^)Pi + 1 + N 



(33) 



(34) 



1 + 7V 

where ( l33T l follows by similar arguments as (fT5t and (l34l 
follows by similar arguments as (fT6] l and (|26] |. Similarly, we 
have 



I{XS;Z^\X^)<-log 



(1 - p2)F2 + 1 + ^ 
1 + N 



(35) 



We also have 

I{X^,X^';Z") = h{Z") - h{Z"\X^^,X^) 

= M^")-E^log(2^e)(l + iV) 

i=l 

From Entropy Power Inequality (EPI) |]8] Lemma I], we have 



h{Z")> -log 



2-KeN 



Therefore, 



n 

> 2log 

= 2 log 

= — log 
2 ^ 



27reiV 



P1+P2 + 2pVPj^ + 1 
Pi + P2 + 2p^/I^T^ +1 + N 



(36) 



Pi + P2 + Ip^/lWi + 1 
where (l36T l follows from (ISTT i. Thus, 



^ ri^^ [N + l)(Pi + P2 + 2p^I\P2 + 1) 
- 2 Pi + P2 + 2p^/Pj^ +1 + N 

Using (EB, (|32l), (in, (O and (l37]l, we have 

2nP 
n 



(37) 



< - log(Pi + P2 + 2p./l\P2 + 1) 

_ n (Pi + P2 + 2p^I\P^ + 1 + iV) (1 + iV) 
2 ((1 - p2)p^ + 1 + iV)((l - p2)P2 + 1 + TV) 



ni?i + ni?2 + 3ne„ 



(38) 



plugging in N in ( |29] l, we have 

2P < i log(Pi + P2 + 2p^/KP2 + 1) 
+ R1+R2 + 3e„ 



1, 1 
— log 

2 1 - , 



(39) 

Hence, for the case of < p < p*, from (|28]l and 

( [39l ), and letting n — > cx), we have proved R <Ti. 

Finally, for the case where p > p*, though we do not have 
( [39l ), (l26b . ( l27b . (|28] | and Q still hold, and by letting n — > 00, 
we have proved P < T2. 

Hence, for all cases of p e [0, 1], we have proved that the 
achievable rate either satisfy R < Ti 01 R < T2, and thus. 
Theorem 1 is proved. 

■ 

IV. A Lower Bound 

Theorem 2 The lower bound of the capacity of the above 
Gaussian multiple access diamond channel is 

Pl + il0g[l + (l-p2)P2] 
P2 + ^l0g[l + (l-p2)Pi] 
i l0g[l + Pi + P2 + 2p^Pj^ 

Ri + R2-\ log 1 



max mm 

o<p<p° 



(40) 



where 



Vl-exp(-2min(Pi,P2)) 



(41) 



Proof: Consider a pair of zero-mean jointly Gaussian 
random variables (Xi,X2), such that the covariance of Xk 
is Pfe, k = 1,2 and the correlation coefficient between Xi 
and X2 is p. 
The condition 

< p < p° 



is equivalent to 



1 1 

min(Pi,P2) > 2 log — 



p^ 



Codebook generation: Randomly generate 2"^^ indepen- 
dent codewords ^"(i), i — l,...,2"^i according to p{x{) 
and randomly generate 2"^^ independent codewords x^ii), 
i — 1,...,2"^2 according to p{x2). Then, with probability 
1, for every codeword Xi{i), i = 1,...,2"^S there are 
21(^2 2 i°s i_p2 ) sequences joint typical with ac- 
cording to the given Gaussian distribution. Similarly, with 
probability 1, for every codeword («), i = 1, . . . , 2"^^, there 
are 2"(^^ 2 i°g i_p2 ) ^j^^i sequences joint typical with X2{i)- 
We collect all the joint typical codeword pairs (.t" (z), 3^2 (j)) 
among all the possible combinations and index them as 
{x1,x^){k), for fc = 1, . . . , 2"-«, where 



R — Ri + R2 



- log — 
2 ^ 1 



1 



(42) 



p- 

Encoding: When the message W = w, for w = 1, . . . , 2"^, 
the source nodes finds the pair that corresponds 

to{x'l,x^){w). It sends index i £ {1,2,- •• ,2"-^i} to Relay 
1 and index j e {1, 2, • • • , 2"^^} Relay 2. Relay 1 upon 



receiving index i, sends into the multiple access channel. 
Relay 2 upon receiving index j, sends (j) into the multiple 
access channel. 

Decoding: Upon receiving Y", the receiver declares w 
is sent if {x" , X2){'w) is jointly typical with the received 
codeword. If no such w exists, or if there is more than one 
such, an error is declared. 

Probability of Error: By a similar argument as in ||2j Sec. 
14.3.1], we can show that the probability of error goes to zero 
if following conditions are satisfied 

Ri < IiXi;Y,X2) 
R2<I{X2;Y,Xi) 
R<I{Xi,X2;Y) 

which means 

(43) 
(44) 

-2\ (45) 

Thus, based on (|42ll, (|43]l, (Ell and (|45]l, Theorem|2]is proved. 



tions of p: 



i?<i?2 + ^l0g[l + (l-p2)Pi] 

R<R, + hog[l + {l-p^)P2] 
i? < i log[l + P1+P2 + 2p/P^ 



V. Symmetric Case and Capacity 

Comparing the upper and lower bounds proposed in The- 
orem [T] and |2] we see that they take on similar forms, more 
specifically, the four functions after the minimum in ^ is 
exactly the same as that in ( |40l i. Thus, if the parameters of 
the Gaussian multiple access diamond channel, i?i , i?2 , Pi 
and P2, is such that p° > p* and Ti > T2, the upper and 
lower bounds meet providing us with the exact capacity of 
the channel. 

To show that there indeed exist channels such that the 
upper and lower bounds meet, in this section, we focus on 
the symmetric case, i.e.. Pi = P2 = P and Ri ^ R2 = Ro- 
lf the channel is such that 

Ro > ilog(l + 4P) 

it is clear that the multiple access channel in the second stage 
is the bottleneck of the whole network, and thus, the capacity 
is equal to i log (1 + 4P). On the other hand, if the channel 
is such that 

ilog(l + 2P) > 2Ro 

it is clear that the two separate links in the first stage is the 
bottleneck of the whole network, and the capacity is equal 
to 2Rq. Thus, we only need to focus on the nontrivial cases 
where 

i log (1 + 2P)<Ro<^ log (1 + 4P) (46) 



/i(p) = ^o + ^log[l + (l-p^)P] 
/2(p) = ilog[l + 2(l + p)P] 



A 



1 



1 



f,ip) = 2Ro--\og-^_^.^ 

Then, for the symmetric case. Theorem [T] and Theorem |2] 
becomes 

Corollary 1 An upper bound on the capacity of the symmetric 
Gaussian multiple access diamond channel is 



where 



max(Ti, 



^1 = r,^J^^J^ min{/i(p),./2(p),/3(p)} 

0<p<p* 

T2 = max min{/i(p),/2(p),/3(0)} 

p*<p<i 



(47) 



and 



1 1 

4P2 ^ 2P 



Corollary 2 A lower bound on the capacity of the symmetric 
Gaussian multiple access diamond channel is 



max min{/i(p),/2(p),/3(p)} 

0<p<p* 



where 



p° = vT^2^^ 



Comparing Corollaries [T] and |2] we obtain the following 
theorem: 

Theorem 3 For the symmetric Gaussian multiple access di- 
amond channel, the above upper and lower bound on the 
capacity meet iff the channel parameters are such that 



P°>P2 
P*>Pl 
/1(P*)</3(P2) 



(48) 

(49) 
(50) 



To simplify presentation, let us define the following func- fiip) < fsip) for P ^ y 



where pi and p2 are the positive roots of the second order 
equations fi{p) — f2{p) cind fj,{p) — .f2ip), respectively. In 
this case, the capacity is /3(p2)- 

Proof: It is straightforward to check that for channels 
that satisfy (l46T l. the second order equations = /2(p) 

and f3{p) — f2{p) both have one and only one positive root. 
Furthermore, pi,p2 € (0,1). 

It can be seen that both fi{p) and f3{p) are strictly 
decreasing in p, while f2{p) is strictly increasing in p. If the 
channel is such that 1 — ^■in]^_p < 0, then fi{p) > fsip) 

1 > 

and /i(p) > fsip) 



for any p e [0, 1], such as Figure |2] If 1 



1 - 



22«0-P 



otherwise, such as Figure |3] In either case, it means pi and 
P2 either satisfy 

1 



Pl<P2<^ 



22^0 _ p 



(51) 



which corresponds to the dotted line representing /2(p) in 
Figure |3] or 

^^^j^<pI<pI (52) 

which corresponds to the solid line representing /2(p) in 
Figures |2] and |3] 

Since for any p{xi,X2), we always have 

IiXi;Y\X2) + I{X2;Y\Xi) > I{Xi,X2; Y) - /(Xi; X2) 

Evaluating the above equation with jointly Gaussian zero- 
mean P-variance Xi , X2 with correlation p, we obtain 

2(/i(p) - Ro) > f2{p) + {hip) - 2i?o), 

VP,i?o>0,pe [0,1] (53) 

Based on the definition of pi and p2, from dSSl l. we have 

/2(pi) > h{pi) 
f2{P2) < h{P2) 

This means only ( |52] |. i.e., the solid line in Figures |2] and [3] 
is possible. This also means that the lower bound is no larger 
than J2{p2), in fact, when p2 satisfy p2 < p°, the lower bound 
is f2{p2), otherwise, it is f2{p°)- 




Fig. 2. /i(p) >/3(p),Vpg [0,1] 



First, let us consider the case where pi > p2- Under this 
assumption, suppose p2 satisfies p2 > P*, then in the upper 
bound, Ti = f2{p*) and T2 = min(/2(pi), 2i?o)- Since 
f2{p*) < f2{pi) and f2{p*) < f2{p2) = h{p2) < 2Ro, 
the upper bound is min(/2(pi), 2Rq). The lower bound is no 
larger than f2{p2), which means the lower and upper bounds 
do not meet. 

Suppose p2 and pi satsify P2 1^ P* < Pi, then in the 




Pi P2 Pi 

Fig. 3. /i(p) and fz(p) has a crossing point 



upper bound, Ti — 72(^2) and T2 — min(/2(yOi), 2i?o). Since 
/2(p2) < /2(pi) and /2(p2) = h{p2) < 2i?o, the upper 
bound is min(/2(/0i), 2Rq). The lower bound is no larger than 
/2(p2), which means the lower and upper bounds do not meet. 

Suppose pi satsifies p* > pi, then in the upper bound, 
Ti - /2(P2) and T2 = miii(/i(p*),2i?o). Note that ^(pa) = 
fj,{p2) < 2i?o- In this case, the upper and lower bounds meet 
iff T2 < Ti and the lower bound is equal to /2(p2)- The above 
two conditions are satisfied iff p2 < p°, 2i?o > fi{p*) '^nd 
flip*) < f2{p2)- Finally, noting that fi{p*) < f2{p2) impHes 
flip*) ^ /3(P2) < 2_Ro, we have proved Theorem |3] when 
pi > P2- 

Next, let us consider the special case where pi — P2 — 



1 - 



A 



22Hq_p 



= p. This is equivalent to 



P = 



(54) 



22flo + l _ 1 

In this case, since p° > p, the lower bound is f2ip)- The upper 
bound is also f2{p)- Thus, when the channel parameters satisfy 
(|54l i, the upper and lower bounds meet. It is straightforward to 
check that when the channel parameters satisfy (l54t . p* = p 
and conditions (l48Tl-(l50]l satisfy also. Thus, we have proved 
Theorem [3] for all possible (pi, p2)- ■ 
To show that there indeed exist symmetric Gaussian mul- 
tiple access diamond channels that satisfy (I48] l- (l50l l. take for 
example, P = 3 and Rq = 1.2, we then have 

p° = 0.9003,/?* = 0.8471, pi = 0.7734, = 0.7643, 
/i(p*) = 1.6426,/3(p2) = 1.7671 

Thus, for P = 3 and Pq = 1-2, (|48]l-(|50ll are satisfied and the 
achievability results and the converse results coincide, yielding 
the capacity, which is 1.7671. 

To illustrate further, we plot the upper and lower bounds in 
Corollaries [T] and |2] and depict them in Fig. |4] and Fig. |5] for 



the cases of P = 3 and P = 30, respectively. As can be seen, 
the gap between the lower and upper bounds is rather small, 
especially when Rq is relatively small and/or P is relatively 
large. 
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Fig. 4. Comparison of upper and lower bounds with P = 3 
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Fig. 5. Comparison of upper and lower bounds with P = 30 



VI. Conclusions 

We have studied the Gaussian multiple access diamond 
channel and provided upper and lower bounds on the capacity. 
Focusing on the symmetric case, we gave necessary and 
sufficient conditions that the upper and lower bounds meet. 
Thus, for a symmetric Gaussian multiple access diamond 
channels that satisfies these conditions, we have found its 
capacity. 

References 



[1] B. E. Schein. Distributed Coordination in Network Information Theory. 
PhD thesis, Massachusetts Institute of Technology, 2001. 



